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O !' We consider the effect of quantum spin fluctuations on the ground state properties of the Heisen- 

| berg antiferromagnet on an anisotropic triangular lattice using linear spin-wave (LSW) theory. This 

model should describe the magnetic properties of the insulating phase of the k — (BEDT — TTF^X 
family of superconducting molecular crystals. The ground state energy, the staggered magnetiza- 
tion, magnon excitation spectra and spin-wave velocities are computed as a function of the ratio 
of the antiferromagnetic exchange between the second and first neighbours, J2/J1. We find that 
near J2/J1 = 0.5, i.e., in the region where the classical spin configuration changes from a Neel 
ordered phase to a spiral phase, the staggered magnetization vanishes, suggesting the possibility of 
a quantum disordered state. In this region, the quantum correction to the magnetization is large 
CZ2 ' but finite. This is in contrast to the frustrated Heisenberg model on a square lattice, for which 

the quantum correction diverges logarithmically at the transition from the Neel to the collinear 
phase. For large J2/J1, the model becomes a set of chains with frustrated interchain coupling. For 
J2 > 4Ji, the quantum correction to the magnetization, within LSW theory, becomes comparable 
to the classical magnetization, suggesting the possibility of a quantum disordered state. We show 
that, in this regime, the quantum fluctuations are much larger than for a set of weakly coupled 
chains with non-frustated interchain coupling. 
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The study of strongly correlated electron systems in low dimensions is a very active field of research. One of 
the great challenges is to understand the competition between antiferromagnetism and superconductivity found in 
ON ■ cuprate and organic superconductors. Kino and Fukuyamaarecently proposed interacting electron models for a range 
of BEDT-TTF crystals. McKenzie argued that the n - (BEDT ~ TTF) 2 X family can Jpe described by a simplified 
version of one of .their models, a Hubbard model on an anisotropic triangular latticeo. Recent Quantum Monte 
Carlo calculations!!! and calculations at the level of the random-phase approximationQ and the fluctuation-exchange 
1-^ . approximations suggest that at the boundary of the antiferromagnetic phase, this model exhibits superconductivity 
mediated by spin fluctuations. As the anisotropy of the intersite hopping varies, the model changes from the square 
lattice to the isotropic triangular lattice to decoupled chainsa. The wavevector associated with the antiferromagnetic 
O ■ spin fluctuations changes and the superconductivity has been predicted to change from d-wave singlet (as in the 
cuprates) to s-wave triplet in the odd-frequency channel for the isotropic triangular latticea This shows that an 
• *h . understanding of the antiferromagnetic interactions is important for understanding the symmetry of the Cooper pairs 
in the superconducting state. As suggested by Seo and FukuyamaQ, 9 — {BEDT — TTE2 2 RBZn(SCN)4 can be 
described by the model we consider with J 2 / J\ ~ 5. Experimental findings from Mori et alU show that this material 
has a spin-gap. The same model has also been proposed by Horsch and MackB to be relevant to a-NaVO^. 

The Heisenberg model studied here should also describe the magnetic properties otthe molecular crystals K — 
(BEDT - TTFhJL^vith X = Cu[N(CN) 2 ]Cl, Cu(CN) 3 and ds^- Cu[N(CN) 2 }bM which are non-metallic at 
ambient pressuraLJ'Ej. On the basis of NMR lineshapes, KanodaEH has suggested that the magnetic ordering in 
k - (BEDT - TTF) 2 Cu[N(CN) 2 ]Cl and d$ - Cu[N(CN) 2 ]Br are commensurate. The magnetic moment has been 
estimated to be (0.4-1.0) \xb per dimer. Using uniaxial stress within a layer or changing the anion X, it may be 
possible to vary the ratio J 2 / J± and induce a quantum phase transition into a disordered phase or the spiral phase 
discussed here. 

This paper is organized as follows: in Section O, we introduce the model, before presenting linear-spin wave theory 



in Section [II. In Section |IV| we present our results. We find that at J 2 j J\ = 0.5 quantum fluctuations are enhanced 
giving a large but finite correction to the magnetization, suggesting the possibility of having a disordered state. This 
possibility is also found for J 2 / J\ > 4: in this region of parameters, the quantum correction to the magnetization is 
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comparable to the classical magnetization and we find that is much larger than for a set of weakly coupled chains 
with non- frustrated interchain couplings. 

II. THE MODEL 

We consider the Hubbard model on the anisotropic triangular lattice with one electron per site. If the Coulomb 
repulsion between two electrons on the same site is sufficiently large then the ground state is an insulator and a standard 
strong-coupling expansion for the Hubbard Hamiltonian implies that the spin degrees of freedom are described by a 
spin-i Heisenberg model 

H = Jx J2 S i ■ S i + J 2 J2 S ' • Sm t 1 ) 

(ij) (hn) 

We use the notation (ij) to denote nearest-neighbours bonds and (Im) to denote bonds along the north-east diagonals. 
Ji is an antifcrromagnetic exchange between nearest neighbours, i.e., along the vertical and horizontal directions and 
Ji is an antifcrromagnetic exchange along one of the diagonals. J\ and J2 are competing interactions leading to 
magnetic frustation. The model is equivalent to a Heisenberg model on an anisotropic triangular lattice. This lattice 
is shown in Fig.E]. 
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FIG. 1. The anisotropic triangular lattice, showing the competing interactions Ji and J2 that lead to magnetic frustration. 

Note that the special cases Ji = 0, J\ = J2, and J\ = correspond to the square lattice, isotropic triangular 
lattice and decoupled chains, respectively. The parameter values in Reference || suggest that ^ ~ 0.3-1 in the 
k — (BEDT — TTF)iX family and so magnetic frustation will play an important role in these materials. 

Insight can be gained by considering various limits of this model: 

Classical limit. The limit of infinite spin (S — > 00) corresponds to a classical Heisenberg model. The classical 
ground state of the system can be computed straight-forwardly as a function of the ratio J2/J1 assuming that the 
set of possible spin configurations of the system are correctly described by a spiral form: Si = Sue lVi . u is a vector 
expressed in terms of an arbitrary orthonormal basis and q defines the relative orientation of the spins on the lattice. 
This ground state configuration was firstly analyzed inE3. 

Introducing Si in hamiltonian (fil) , we get an expression for the classical energy in terms of the spiral vector q 
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where N is the number of sites on the lattice. For J 2 < Ji/2, the ground state has Neel order with associated wave 
vector q=(7r, tt). For J 2 > Ji/2, the ground state has spiral order with wave vector (q, q) where q = arccos(— Ji/2 J 2 ). 

Limiting cases for S=\. If J2 = then the model reduces to the. Heisenberg model on a square lattice. At zero 
temperature there will be long range Neel order with magnetization^ of (Sf) — 0.3. If J\ is non-zero but small it will 
introduce a small amount of magnetic frustation which will reduce the magnitude of the magnetization in the Neel 
state. If J 2 = J\ then the model reduces to the Heisenberg model an an isotropic triangular lattice. There has been 
some controversy about the ground state of this model. AndersonO originally suggested that the ground state was 
a "spin liquid" with no long-range magnetic order. However, recent numerical work suggests that there is long-range 
order but the quantum fluctuations are so large due, to magnetic frustation that the magnetic moment may be an 
order of magnitude smaller than the classical valuetj. If J\ is non-zero but small we have chains on the diagonals 
of the lattice that are weakly coupled. The case of only two chains corresponds to the "zig-zag" spin chain which is 
equivalent to a single chain with nearest-neighbour and next-nearest neighbour exchange, J\ and J 2 , respectively. This 
spin chain has been extensively studied and is well understood!!!! In the limit of interest here, J 2 3> Ji , there is a gap 
in the spectrum A ~ exp(— const. J 2 / Ji) and there is long-range dimer order and, incommensurate spin correlations. 
McKenzie speculated that this "spin-gap" is still present in the many chain limitcl. 



III. LINEAR SPIN- WAVE THEORY 



Extensive theoretical work has been done with the aim of achieving an understanding of the ground state properties 
of the Heisenberg model on the square and isotropic triangular lattices. One standard and simple way used for 
calculating the magnetization and energy of the magnetically ordered phases of these systems, is linear s piji-w ave 
theory (LSW). LS-W-has satisfactorily reproduced the ground state energy and magnetization of the squareE3£3 and 
triangular latticestjo. More sophisticated methods, such as the variational approach of Huse and Elsen£3 have 
corroborated this fast. In the present work, we apply linear spin- wave theory to the model of interest. Recently, 
Bhaumik and BoseEil considered the linear spin wave theory for the Neel phase (J 2 /Ji < 0.5) of the same model. 
However, they did net evaluate the quantum, corrections to the magnetization. 

Following MiyakeEj and Singh and HuseE^I, it is convenient to rotate the quantum projection axis of the spins at 
each site along its classical direction. This transformation is done by introducing the following rotated spin operators 

Sf = Si X cos{di) + Si sm{6i) 
Sf = Si v 

Sf = Si Z cos(0i) - Si x mn(^i) 

(3) 

in Hamiltonian (|l]). 

This rotation simplifies the spin-wave treatment so that only one type of bosons rather than three is needed to 
describe the spin operators. After this transformation the Hamiltonian is 

{ij) 

+ J 2 J2 cob(0, - 9 m )(S?S x m - S?S*J + sia(0« - e m )(SfS^ - S?S z m ) + Sf§l -B^Sf 

(lm) i 

(4) 

where we have introduced an auxiliary magnetic field, B, in the z direction of rotated basis in order to compute the 
magnetization. ■— ■ 

Using the standard Holstein-Primakoff representatiorJlj for the spin operators we expand them with respect to 1 / S 
and we take the Fourier Transform of the boson operators. The resulting Hamiltonian up to order 0(1/ S) 

H = Ji5 2 cos (^ ~ °j) + J 2 s2 cos (^ ~ 6 ™> ~ NBS 

{ij) (lm) 

+ S^(JxAi(k) + J 2 A 2 (k) - JxCi - J 2 C 2 + B/S)a+a k 

k 
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+ S$](JiBi(k) + J 2 B 2 (k))(a+a\ + a k a-k) 

k 

(5) 

is not diagonal in the boson operators. N is the number of lattice sites in the system and the coefficients A, B and 
C are 



Al W = Jj E C0S ( k ( r J - r 0)(cos(^ - 9 S ) + 1) 
A 2 (k) = — ^ cos(k(r m - r;))(cos(0; - m ) + 1) 

(lm) 

B ^ = 2^ E ex P( ik ^ ~ r,))(cos(^ - 0,) - 1) 

B a (k) = ^7 E e MM*m - r,))(cos(0, - m ) - 1) 



2iV 

(2m) 

<«) 

C 2 = |: X] COs(0i - ro ) 



(6) 



where again (ij) sums over the nearest neighbours and (lm) over the next-nearest ones. 

Hamiltonian (H) explicitly breaks up the SU(2) symmetry of the spins at each site. Only magnetically ordered 
states can be analyzed with this method and the expansion is valid only when the correction due to the zero-point 
motion of the spins is sufficiently small. 

Following standard LSW theory we diagonalize hamiltonian (|5|) using a Bogoliubov transformation, assuming, as 
we have already discussed, an spiral ordering of the spins in the lattice, so that the relative angle between two 
nearest-neighbour spins is q, and 2q for two next-nearest-neighbours. The diagonal Hamiltonian reads 

H = NS 2 J{q) - NBS 

- ^ 5 E4 (J(k + q) + J(k)) + B/s ~ 2J(q) - w(k ' B)} 

+ 5>(k,£0a+a k (7) 

k 

where the sums run over the first Brioullin zone and creates boson spin excitations (magnons) with the dispersion 
relation 

Oj(k,B) = 2S[(J(k) + B/S - J(q))(i(J(k + q) + J(k - q)) + B/S - J(q))] 1/2 (8) 

Equation (Q) explicitly shows the zero bosonic modes at the momentum wavevectors, k=q and k=0, for B = 0. 

The ground state energy of the system, Eq, is given by equation (Q), setting the occupation of the bosons to zero, 
and, finally, the magnetization of the system is computed as the derivative of the ground state energy: 

1 ,• dE Q 
< S i > = ~T7 llm "TFT 

N b->o dB 

1 g l ^ ^(J(k + q) + J(k-q)) + J(k)-2J(q) 
- S+ 2~ S 2N^ w(k,B = 0) (9) 

This expression recover.s-.the LSW expression for the magnetization on the square latticeEl, q=(7r,7r), and the 
isotropic triangular latticeE3, q = (27r/3, 2tc/S). 
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IV. RESULTS 



We have numerically evaluated the integrals in equation (^) and (^J) to obtain the ground state energy and magne- 
tization as a function of J%/ 1 J\. 

A. Ground state energy 

In Fig. H we plot the ground state energy per site as a function of J%l J\. The classical energy is also included in 
the same figure (dashed line), showing how quantum fluctuations lower the ground state energy. The maximum in 
the total energy is attained around J%/ J\ ~ 0.7, which approximately coincides with the position of the maximum 
in the classical energy at \p2j2: at this point, geometrical frustration attains its maximum. A cusp is found at the 
transition from the Neel to the spiral phase at J2/J1 — 0.5, which results, as will be later seen, from the softening 
of the spin-wave modes at the transition poiat. We also plot in the same figure, results for the ground state energy 
obtained from a series expansion calculationEi Although LSW is a simple approximation for computing ground state 
properties of frustrated systems, the energies obtained are in good agreement with the series expansion results. 
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FIG. 2. The total ground state energy (full line) for S — \ and classical ground state energy (dashed line) as a function of 
the amounit-pf magnetic frustration J2/J1. The squares represent the ground state energies obtained from a series expansion 
calculations. The error bars associated to the series expansion energies are, at most, of order 10 -3 , so they cannot be seen in 
this plot. 



B. Magnetization 

In Fig. H we show results for the magnetization_fbr S — | as a function of J2/ J\ ■ The results are qualitatively 
similar to those of a recent series expansion studyO. We_have tested the accuracy of the calculation by comparing 
with known results for the square (J2/J1 = 0.0) latticeEil with magnetization (Sf) — 0.30339, and the triangular 
latticai3 (J2/Ji = 1.0) with (Sf) = 0.23868. We find a strong dip in the magnetization at J2/J1 = 0.5 suggesting the 
possibility of a disordered phase in its neighbourhood. The nature of the ground state is unclear and will have to be 
determined by more sophisticated techniques. 

It is instructive to mention results reported on other lattices such as the J\ — J2 square lattice (for which-there is 
frustration along both diagonals), for which extensive work has been carried out. Schulz, Ziman and Poilblancc^l, using 
exact diagonalization of finite cells, get results_£br the magnetization in qualitative agreement with LSW theory and a 
Dyson-Maleev approach performed by GochevEl which treats the interaction between the spin-waiies self-consistently. 
However, on the isotropic triangular lattice with next-nearest neighbours, Deutscher and Everts E3 have shown that, 
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while exact diagonalization shows a finite jump of the magnetization between the collinear and the q — 2n/3 canted 
phases, LSW theory gives a continuous transition. 

From the above discussion we therefore conclude that it is difficult to extract conclusive answers from LSW theory 
for this frustated lattice at the transition point: the interaction between the spin- waves becomes very large due to the 
presence of geometrical frustation leading to the possibility of a completely different state than the classical one and 
more sophisticated methods are needed to describe this region correctly. A recent series expansion studyEJ suggests 
that the system is Neel ordered for J2/J1 < 0.7 and quantum disordered for 0.7 < J2/J1 < 0.9. 



0.3 



0.2 

A 



0.1 



0.0 




0.0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 



J 2 /J 1 

FIG. 3. The effect of frustration on the magnetization calculated from linear spin-wave theory is shown as a function of 
JilJ\- The quantum correction to the magnetization diverges as J2/J1 — > 00. At the Neel-spiral transition (at J2/J1 = 0.5) 
the correction is large due to the softening of the spin- wave modes but finite (see the text). This suggests the possibility of a 
quantum disordered phase at J2/J1 » 0.5 and for J2/J1 > 4. 

V. SPIN- WAVE VELOCITIES AND QUANTUM FLUCTUATIONS 
A. Near Neel-spiral transition 

Insight into the origin of the increase in the quantum fluctuations near J2/ Ji=0.5, can be gained from considering 
the behaviour of the spin- wave velocities near the zero bosonic modes: (0,0) and (ir, n). In Fig. ||, we show the 
dependence of the magnon frequencies as a function of the wavevector k along the (k, k) direction in the parameter 
region < J2/J1 < 0.5 where the (n, tt) state is classically stable. Except at J2/J1 = 0.5 the magnon excitation 
vanishes linearly with wavevector and we define the associatied spin- wave velocity along the (k, k) direction as c+ and 
c_ along the direction perpendicular to it: (fc, —k). 

While near the zero modes, (0,0) and the spin- wave velocity c + w 2SJ\yj2{\ — 2J 2 / J\), c_ does not depend 

on J2, c_ « 2\f2SJ\. Hence, the modes soften along the diagonal direction and the velocity c+ vanishes at the 
Neel-spiral transition. This can be clearly seen in Fig. |f|. 
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FIG. 4. The softening of the spin-waves near the commensurate-incommensurate transition. The spin-wave dispersion 
u}(k x ,k y ) along the (fc, fc) direction is shown for different values of J2/J1. Note that the dispersion near and n becomes 
quadratic at the transition. As discussed in the text, this leads to an increase in the quantum correction to the magnetization. 
J2/J1 = (dashed line), J2/J1 = 0.25 (dashed- dotted line) and J2/J1 = 0.5 (full line). 

From the above analysis we can now explain the behaviour of the low-energy, long-wavelength component of 
the quantum-fluctuations as J2/J1 approaches 0.5. At this point and near (k x ,k y ) ~ (0,0), the correction to the 
magnetization due to quantum fluctuations (see Eqn.^)) for S = | can be approximated by 



Sf 



11 If dk+dk 



2 2tt 2 



^ 2 

(log(2fc c )-21og(£: c /2) + 2) 

(10) 



where the integral is expressed in terms of the diagonal directions, fc+ = k x + k y and fc_ = k x — k y , and k c is a cutoff 
in the momentum. As expected, the lowest order term that appears in the integral along the k + direction is quartic, 
because the spin- wave velocity vanishes, c + — * 0. This behaviour of the mapion spectrum, where the softening occurs 
only along one direction, has also been found by Chubukov and JolicoeurEa on the isotropic triangular lattice with 
next-nearest neighbours at the transition from the collinear to the incommensurate phase. They were able to show 
that the transition point shifts from the LSW theory result when treating the effect of— quantum fluctuations in a 
self-consistent way. This is in agreement with the results obtained using series expansionsEa, which give the transition 
point at J2/ Ji—Q.7, instead of 0.5 obtained within LSW theory. 

As shown in (|l0|) the integral is finite but gives a much larger correction than for the square lattice ( J 2 =0) case. 
We find that taking a cutoff of 0.17T, the integral in the correction is two to three times larger than for the square 
lattice ( J 2 = 0), for the same region of integration. Therefore, the reduction in energy of the bosonic modes along 
the fc+ direction (see Fig. ||) is responsible for a finite but large enhancement of the quantum correction to the 
magnetization. 

It is interesting to compare this result with the one obtained on the J\ — J2 square lattice: in this case, the correction 
due to the quantum fluctuations at J2/J1 = 0.5, can be approximated by 

1 _ l _ j_ r dk + dk^ 

[ 1 ; 2 ~ 2 8tt2 J j lk+SA , , fc klkl 



m 4 + (- 



1 1 f dkrgdky 



2 (2tt)2 J 

kx ky 



(11) 
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the last integral in Eqn.(]ll|) shows a divergence that behaves like the square of a logarithm. Therefore, we find a 
different qualitative behaviour of the quantum fluctuations for the anisotropic lattice as compared to the J\ — J-2 
square lattice. 



B. Weakly coupled chains (J2 >> Ji) 

We have analyzed the structure of the magnon excitation spectra in the neighbourhood of the zero bosonic eigencn- 
ergies: (0,0) and (q,q), with q — > tt/2 as J%/J\ — > 00. We find that the spin-wave velocities are c_ w \/2SJ\ and 
c + w 2y/2SJ2- The dispersion relation is plotted in Fig. |[ 




FIG. 5. The spin- wave dispersion relation along the (fc, k) direction in the spiral phase. As J2/J1 increases the limit 
of weakly coupled chains is approached and the classical ordering wavevector, q, at which the spin- wave energy vanishes, 
approaches tt/2. J2/J1 = 1 (full curve), J2/J1 = 2 (dashed curve) and J2/J1 = 4 (dashed-dotted curve). 

Again, we analyze the low-energy, long- wavelength contributions to the integral appearing in Eq. (^). Near the zero 
modes: (0,0), and (q,q), it can be approximated by an elliptic integral 

dk+dk- 

(12) 



v/(c + fc + ) 2 + (c_fe_)2 

In the limit J2/J1 >> 1, the ratio of velocities diverges as c + /c_ « 2J2/J1, and the elliptic integral can be approxi- 
mated by a logarithm. Taking a cut-off of tt/2, we get for the magnetization (Eq.||) 

<Sf>« S + 3^1og(J 1 /2J 2 ) (13) 

As expected, the quantum fluctuations diverge as J2/J1 — > 00. For 5=1 the critical value that sets < Sf >= is 
J2/J1 ~ 2. Although this is just a crude estimate it is roughly consistent with Fig. |[ _ . 

It is interesting to compare this result with the one obtained by Affleck, Gelfand and SinghtJ for the anisotropic 
Jy — Jx square lattice where J y is a non-frustrating interaction which can be gradually turned off. In the limit 
Jyl ' Jx — > 0, the integral reduces to 



<S?>*S+±log(J y /J x ) (14) 

Z7T 



taking a momentum cut-off of tt. Note that the factor multiplying the logarithm is smaller in this case than in 
the anisotropic triangular lattice, and, therefore, the critical value obtained, within spin-wave theory, is an order 
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of magnitude larger: J x /J y ~ 23.1. Numerical workil and renormalization group argumentsB'Ell on the anisotropic 
square lattice suggests the existence of long range Neel order for an infinitesimal coupling betwefiu-the chains (J y /J x <C 
1). A similar renormalization group analysis for the appropiate SO (3) nonlinear sigma modeScia, could be performed 
to gain some insight into the ground state of our model in this parameter region. Also numerical calculations using more 
sophisticated numerical techniques could be performed to find whether long range order persists for an infinitesimal 
coupling or not. However, our analysis clearly shows that for comparable interchain coupling the quantum fluctuations 
are much larger than for the case where the interchain coupling is non-frustrated. 

VI. CONCLUSIONS 

We have presented a linear spin-wave analysis of the Heisenberg antiferromagnetic Heisenberg model on an 
anisotropic triangular lattice. The Heisenberg model on this lattice should be the relevant model for describing 
the insulating properties of certain layered organic superconductors. The correction to both, the energy and magne- 
tization due to quantum fluctuations, is computed by means of linear spin- wave theory for different values of J%l J\. 
The results obtained from LSW theory suggest the possibility of finding a disordered state near J2/J1 ~ 0.5. This 
possibility also exists for values of J2/J1 > 4, where the system resembles a set of chains weakly coupled by a frus- 
trated interaction. In this region of parameters we find that quantum fluctuations are larger than in the case where 
the chains are weakly coupled by a non-frustrated interaction. Further work using other numerical approaches should 
be used to analyze in more detail the results presented here. 
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